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ABSTRACT 

The  reliability  of  steady-state  visual  evoked 
responses  (VER’s)  was  determined  for  nine 
normal  subjects  using  Fourier  analyses  with 
1.0  and  0.25  Hz  bln  resolutions.  No  correlations 
were  found  between  VER  amplitudes  and  sub¬ 
jects’  reports  of  attention,  accommodation,  fix¬ 
ation,  or  perceived  organization  of  the  stimu¬ 
lus.  Across  subjects,  there  was  also  no  sus¬ 
tained  amplitude  modulation  of  the  VER  by  any 
frequency  (including  alpha),  and  frequency 
drift  of  the  VER  did  not  contribute  significantly 
to  its  amplitude  variability.  Modeling,  using 
mixed  sine  waves  to  simulate  different  signal/ 
noise  (S/N)  ratios,  established  that  a  signifi¬ 
cant  portion  of  VER  amplitude  variability  can 
be  accounted  for  by  noise  which  occurs  at  the 
same  frequency  as  the  VER  and  which  is  not 
removed  by  ensemble  averaging. 
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The  VER  is  a  gross  electrical  response  gen¬ 
erated  primarily  by  neurons  in  the  visual  cortex.1 
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As  such,  it  is  a  potentially  valuable,  noninvasive 
tool  for  objectively  assessing  many  aspects  of 
vision.  VER  latency  data  are  useful  in  the  diag¬ 
nosis  of  optic  neuritis,2  which  is  often  associated 
with  multiple  sclerosis,3"8  and  VER  amplitudes 
are  related  to  pattern  and  brightness  percep¬ 
tions.7  This  relationship  allows  the  use  of  the 
VER  for  refractive  error  and  acuity  determina¬ 
tions,®-12  assessment  of  recovery  from  photic  and 
similar  insults,  and  for  other  assessments  re¬ 
quiring  an  objective  measurement  of  perception/ 
vision.7  Usefulness  of  the  VER  as  an  assessment 
tool  is  somewhat  compromised,  however,  be¬ 
cause  the  amplitude  of  the  evoked  response  is 
often  quite  unreliable;  i.e.,  VER  amplitudes 
change  with  no  apparent  subject,  stimulus,  or 
recording  device  changes.13"16 

Four  factors  have  been  suggested  to  account 
for  this  variability:  (1)  data  analysis  procedures, 
(2)  changes  in  the  ocular  status  of  the  subject 
(e.g.,  accommodation,  fixation,  etc.),  (3)  changes 
in  information  processing  occurring  at  central 
levels  in  the  subject’s  visual  system  (e.g., 
changes  caused  by  variations  in  cortical  excita¬ 
bility)17-19  and/or  by  correlates  of  the  alpha 
rhythm,20-24 and  (4)  changes  in  background  noise 
occurring  at  the  same  frequency  as  the  VER, 
hence  recorded  with  it. 

The  literature  is  not  very  helpful  in  assessing 
the  relative  contributions  of  the  factors.  Van 
Brocklin  et  al.18  have  documented  VER  ampli¬ 
tude  variability,  but  they  made  no  attempt  to 
correlate  changes  in  amplitudes  with  changes  in 
their  subjects’  perceptual  and/or  attentional 
states,  nor  did  they  consider  the  effects  of  noise 
on  the  VER.  Because  of  this  lack  of  available 
information,  the  following  study  was  designed 
(1)  to  replicate  Van  Brocklin’s  study  using  an 
independent  analysis  system,  (2)  to  investigate 
potential  correlations  between  VER  amplitudes 
and  subjects’  perceptual  reports,  and  (3)  to  study 
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the  sources  of  VER  variability  using  modeling 
techniques. 

METHODS 

One  female  and  eight  males  served  as  subjects. 
Mean  age  was  29.1  years  (range  20  to  39  years) 
and  each  subject  was  an  experienced  VER  ob¬ 
server.  All  except  BU  were  emmetropes  or  were 
corrected  to  6/6  (20/20)  or  better.  None  except 
BU  had  significant  visual  anomalies  or  pathol¬ 
ogies;  BU  had  unilateral  6/60  (20/200)  ambly¬ 
opia  of  unknown  etiology. 

Subjects  were  seated  comfortably  in  a  dark¬ 
ened,  shielded  room  2.6  m  from  a  525  x  400  min 
arc  Ayden  model  8026  high  resolution  video 
system.  This  monitor  uses  a  Mitsubishi  model 
C-6912  video  monitor  with  short  persistence 
phosphors.  A  DEC  11-24  computer  produced  a 
black  and  white  checkerboard  consisting  of  15 
min  arc  checks  on  the  display.  Luminances  of 
the  actual  checks  were  measured  with  a  Gamma 
Scientific  model  700  log-linear  photometer  sys¬ 
tem.  The  bright  checks  averaged  102.8  cd/m2 
(30  ft-L)  and  the  dark  checks  averaged  15.42  cd/ 
m2  (4.5  ft-L). 

To  produce  the  evoked  potentials,  the  display 
was  square  wave  reversed  at  an  alternation  rate 
of  15  contrast  reversals  per  second.  This  alter¬ 
nation  rate  was  selected  (in  part)  to  synchronize 
with  the  refresh  rate  of  the  video  system,  thus 
preventing  luminance  artifacts  on  the  display. 
In  fact,  no  luminance  fluctuations  could  be  de¬ 
tected  when  the  display  was  “integrated”  by 
viewing  it  through  a  high-plus  lens. 

There  was  a  small  black  dot  in  the  center  of 
the  display  which  subjects  were  instructed  to 
fixate  except  during  rest  periods  between  trials. 
Each  subject  viewed  the  display  for  10  trials, 
each  of  which  consisted  of  60  sec  of  blank  screen 
(with  the  same  mean  luminance  as  the  check¬ 
erboard)  followed  by  80  sec  of  phase-reversing 
checkerboard;  1.5  min  of  rest  were  provided 
between  trials. 

Seal** 

To  correlate  gross  variations  in  VER  ampli¬ 
tudes  with  gross  variations  in  the  subjects’  vis¬ 
ual/perceptual  conditions,  each  was  asked  to 
make  four  ratings  immediately  after  each  of  the 
VER  trials: 

1.  Attention:  “Rate  your  degree  of  attention 
during  the  time  the  checkerboard  was  visible  on 
a  1  to  7  scale,  with  1  being  groggy,  4  being  relaxed 
but  alert,  and  7  being  sharp.” 

2.  Fixation:  “Rate  the  percentage  of  time 
when  the  checkerboard  was  visible  that  you  were 
able  to  hold  your  fixation  on  the  center  dot  on 
the  display  screen.” 


3.  Accommodation:  “Rate  the  percentage  of 
time  when  the  checkerboard  was  visible  that  the 
entire  display  screen  stayed  clear  and  in  focus.” 

4.  Uniformity:  “Rate  the  percentage  of  time 
when  the  checkerboard  was  visible  that  the  dis¬ 
play  did  not  appear  to  move  about  in  space, 
rearrange  itself  into  small  segments  or  patterns, 
or  form  diagonal  or  cross  hatch  lines.” 

These  questions  were  discussed  with  each  sub¬ 
ject  before  any  data  were  obtained  and  were 
repeated  after  each  trial.  Thus,  each  subject 
responded  to  each  of  the  four  questions  10  times. 


Recording 

Conventional  procedures  were  used  to  record 
the  VER’s.  Silver  disc  electrodes  were  attached 
to  each  earlobe  and  to  the  scalp,  on  the  midline, 
1.5  cm  above  the  inion  (electrode  to  electrode 
resistances  were  all  5,000  ohms  or  less).  Outputs 
from  the  electrodes  were  differentially  amplified 
(Grass  model  7P511  amplifiers  with  frequency 
cutoffs,  0.1  and  100  Hz),  and  the  analog  data 
were  stored  on  magnetic  tape  (Ampex  model  PR 
2200  FM  system). 

Whereas  specific  procedures  differ  slightly  in 
the  experiments  described  below,  typically  the 
digitized  VER  data  (digitization  rate  256  Hz) 
were  ensemble  averaged  and  then  analyzed  using 
a  fast  Fourier  transform  (FFT).  For  each  trial, 
the  90th  sec  (30  sec  after  the  checkerboard  first 
became  visible  to  the  subject)  served  as  the 
beginning  of  the  ensemble  averaging  period.  The 
90th  sec  was  selected  to  allow  initial  transients 
and  instabilities  •'  i  the  VER  to  pass.26  After  the 
90th  sec,  samples  of  data  ranging  from  1  to  40 
sec  in  length  were  averaged  using  1.0-sec  epochs 
(sweeps)  and  then  Fourier  analyzed  to  obtain 
the  amplitudes  of  the  15.0  Hz  VER  components. 
The  mean  and  SD  of  the  10  amplitude  values 
for  each  subject/total  sample  length  combina¬ 
tion  were  then  used  to  calculate  variability  in¬ 
dexes  (VI).‘  For  each  set  of  10  amplitudes,  the 
VI  is  the  SD  of  the  values  expressed  as  a  per¬ 
centage  of  their  mean,  as  shown  in  Equation  1. 


VI  = 


SD 

Mean 


x  100 


(1) 


‘Statistically,  this  same  term  is  often  called  the 
Coefficient  of  Variation.  It  should  be  noted  that  vari¬ 
ability  is  inversely  related  to  reliability.  Data  which 
show  considerable  variability  when  determined  using 
identical  test  conditions  would  be  considered  unrelia¬ 
ble.  An  often  confused  term  is  “validity,”  which  by 
definition  is  the  extent  to  which  a  test  measures  that 
which  it  is  intended  to  measure.  It  is  possible  for  a 
test  to  be  reliable  but  not  valid  and,  to  a  lesser  extent, 
the  converse  is  also  possible. 
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To  show  how  the  use  of  different  FFT  fre¬ 
quency  resolutions  would  effect  the  variability 
of  the  VER’s,  all  data  were  analyzed  using  1.0 
and  0.25  Hz  wide  frequency  bins. 

These  analyses  provided  VI  data,  but  because 
signal/noise  ratios  and  15.0  Hz  noise  variability 
data  were  also  needed,  the  same  analytical  pro¬ 
cedures  were  repeated  for  the  noise  data  (ob¬ 
tained  while  the  subjects  were  viewing  the  blank 
screen)  except  that  noise  analyses  began  with 
the  15th  sec  of  each  data  trial. 

RESULTS 

Fig.  1  presents  a  summary  of  the  nine  subjects’ 
mean  15.0  Hz  VER  and  noise  amplitude  data 
(1.0  Hz  resolutions)  for  1.0  to  40  sec  ensemble 
averaging  periods.  Both  the  VER  and  noise 
curves  initially  drop  rapidly  showing  the  effects 
of  ensemble  averaging,  but  beyond  about  10  sec 
the  curves  flatten.  The  S/N  curve,  which  shows 
the  ratio  of  the  mean  VER  amplitude  to  the 
mean  noise  amplitude  for  each  averaging  period, 
increases  up  to  40  sec  where  the  mean  S/N  ratio 
is  about  19/1  (median,  14.1/1). 


To  compare  the  reliabilities  of  the  VER  am¬ 
plitudes  across  subjects  and  measurement  con¬ 
ditions,  Vi’s  were  used  to  normalize  the  data. 
Curves  showing  the  relation  of  the  mean  VI 
values  to  the  length  of  the  data  sample  which 
was  ensemble  averaged  are  shown  in  Fig.  2.  Also 
shown  are  additional  VI  data  obtained  in  an¬ 
other  laboratory  under  somewhat  similar  con¬ 
ditions.1* 

Several  conclusions  can  be  drawn  from  Fig.  2. 
First,  VER  amplitudes  from  trained,  cooperative 
adults  vary  significantly;  even  more  variability 
might  be  found  in  data  from  uncooperative  sub¬ 
jects.26  Second,  there  is  little  difference  between 
the  VI  values  found  using  1.0  and  0.25  Hz  reso¬ 
lutions.  Third,  the  curves  flatten  when  more 
than  20  sec  of  data  are  averaged. 

FACTORS  WHICH  MAY  ACCOUNT  FOR  VER 
VARIABILITY 

VER  amplitudes  are  variable  even  when  sub¬ 
ject,  stimulus,  and  analysis  conditions  are  held 
as  constant  as  possible.  Four  factors  were  sug- 


Fia  1.  Mean  data  from  nine  subjects  are  indteated  by  large  symbols.  Smaisr  symbols  enclose  a  t.0  SO  range 
about  each  mean.  The  VER  and  noise  ewes  demonstrate  how  changing  the  length  of  the  total  ensemble 
averaging  period  affects  ihe  ampttudes  of  these  data.  Beyond  about  10  sec,  increasing  the  total  averaging  period 
appears  to  have  Ittle  effect  on  these  ampMudes,  but  the  S/N  ratio  increases  steatRy  up  to  40  sec  [1.0  sec  epochs 
(sweeps)  were  used  to  analyze  ell  data). 
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TOTAL  SECONDS  OF  DATA 

Fio.2.  Large  symbols  on  the  upper  two  curves  represent  moan  VI  data  from  this  study  using  1 .0  and  0.25  Hz 
frequency  resolutions.  (Epoch  (sweep)  lengths  of  1 .0  and  4.0  sec,  respectively].  SmaMr  symbols  enclose  1 .0  SD 
ranges.  The  curves  show  that  beyond  about  20  sec  of  data,  both  resolutions  yield  the  same  VI  values.  They  also 
show  that  beyond  20  sec  there  is  only  a  very  gradual  trend  toward  less  variaMty  with  increasingly  long  averaging 
periods.  Note  that  the  number  of  epochs  required  for  a  given  total  averaging  period  is  (afferent  for  the  1 .0  vs.  the 
0.25  Hz  resolution  analyses,  and  that  the  analyses  are  not  Independent  because  al  were  started  with  the  90th 
sec  of  data.  The  lower  curve  shows  Vi's  from  Van  BrockNn  et  al.1*  obtained  using  nine  subjects  and  2.56  Hz 
resolution  Fourier  bins  (384  msec  epochs). 


gested  above  to  account  for  this  variability  and 
they  can  now  be  assessed  individually. 

Variability  Associated  with  Data  Analysis 
Artifacts 

Variability  could  have  entered  via  analysis 
procedures  at  several  levels;  e.g.,  data  storage 
devices  such  as  tape  recorders  could  have  caused 
artifacts,  or  the  computer  algorithms  used  to 
analyze  the  VER  data  could  have  been  faulty. 
Subtle  problems  such  as  windowing,  aliasing, 
and  frequency  drifts  could  also  have  caused  the 
FFT  to  make  the  VER  amplitudes  appear  vari¬ 
able.27 

A  number  of  quality  assurance  tests  were  con¬ 
ducted  to  ensure  that  these  problems  were  not 
occurring.  They  involved  repeated  analyses  of 
actual  VER  data  and  sine  wave  simulations,  and 
the  use  of  a  low-pass  analog  filter  to  remove 
high-frequency  signals  which  could  be  aliased  to 
the  15.0  Hz  VER  frequency.  These  procedures 
demonstrated  that  less  than  2%  of  the  total  VER 
variability  could  be  accounted  for  by  equipment 
artifacts. 

A  phenomenon  which  could  cause  arti factual 


variability  is  frequency  drift  of  the  VER  signal 
itself  which  would  cause  “leakage”  into  fre¬ 
quency  bins  adjacent  to  that  representing  the 
VER  signal.  The  amount  of  this  leakage  was 
determined  empirically  by  using  a  15.0  Hz  sine 
wave  which  was  then  shifted  sequentially  in 
increments  equal  to  10%  of  the  width  of  the 
Fourier  bin.  The  data  in  Table  1  show  the  pro¬ 
portion  of  leakage  for  1.0  and  0.25  Hz  resolutions 
that  resulted  from  this  procedure.  These  data 
show  that  equal  magnitude  frequency  drifts 
would  have  very  different  effects  depending  on 
whether  1.0  or  0.25  Hz  bins  were  being  used.  If 
a  significant  amount  of  the  variability  present 
in  the  actual  VER’s  was  caused  by  frequency 
drifts,  then  the  data  obtained  using  0.25  Hz  bins 
should  have  been  more  variable  than  the  data 
obtained  using  the  1.0  Hz  bins.  As  was  shown 
in  Fig.  2,  this  was  not  the  case. 


Because  the  amplitude  of  the  VER  is  consid¬ 
ered  to  be  an  indicator  of  perception,  any 
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Table  1 .  Leakage  caused  by  frequency  drift. 


Frequency  (Hz) 

Proportion  of  Ampftude 
Represented  m  Bin 
with  15.0  Hz 

Cantor  Frequency 

1.0  Hz  Bin 
Resolution 

0.25  HZ  Bin 
Resolution 

ISO 

15.000 

1.0 

15.1 

15.025 

098 

152 

15.050 

0.93 

15.3 

15.075 

0.85 

15.4 

15.100 

0.76 

15.5 

15.125 

0.64 

156 

15.150 

0.51 

15.7 

15.175 

0.37 

15.8 

15.200 

0.23 

15.9 

15225 

0.11 

16  0 

15.250 

0.00 

changes  that  affect  stimulus  clarity,  brightness, 
contrast,  or  retinal  location  could  affect  VER 
amplitudes  and  be  interpreted  as  variability.  To 
provide  a  gross  evaluation  of  this  relationship, 
correlation  coefficients  were  determined  for  sub¬ 
jects’  ratings  of  attention,  fixation,  accommo¬ 
dation,  and  stimulus  uniformity  vs.  their  VER 
amplitudes  (which  had  been  normalized  by  con¬ 
verting  them  to  Z-scores  to  remove  the  effects 
of  the  subjects’  different  means  and  SD’s). 

Scatter  plot  appearances  and  the  near  zero 
correlations  (Table  2)  show  no  significant  rela¬ 
tion  between  the  visual/perceptual  reports  and 
fluctuations  in  the  VER.  This  suggests  that  fac¬ 
tors  other  than  those  associated  with  perception 
might  be  responsible  for  amplitude  variability. 

There  may,  however,  be  ocular  changes  which 
could  affect  VER  amplitudes  which  may  not  be 
associated  with  perception.  Examples  are  eye 
movements,®-31  blinking,32  and  shifts  in  ocular 
balance.  Armington  has  demonstrated  blink 
evoked  potentials,32  so  it  is  likely  that  blinks 
occurring  during  the  stimulus  viewing  period 
could  cause  artifacts.  To  assess  the  importance 
of  this  factor,  blink  rates  were  measured  by  gross 
electromyogram  recording  for  three  subjects  rep¬ 
resenting  high,  medium,  and  low  VI  scores.  All 
three  subjects  blinked  only  two  to  four  times  per 
minute  during  the  checkerboard  viewing  period; 
thus,  the  results  of  these  blinks  would  not  have 
major  or  differential  effects  on  VI  scores. 

Because  all  the  VER  data  were  obtained  under 
binocular  viewing  conditions,  variability  caused 
by  shifts  in  ocular  dominance  cannot  be  as¬ 
sessed.33-34  It  can  only  be  noted  that  subject  B. 
U.,  who  was  a  6/60  (20/200)  amblyope,  and  who 
presumably  had  relatively  stable  dominance, 
showed  as  much  variability  as  the  other  subjects. 
Binocularity  and  eye  movements,  however,  must 
remain  possible  sources  of  variability  pending 
further  investigation. 


Variability  Associated  with  Changes  in 
Central  Processing 

It  has  been  suggested  that  the  amplitude  of 
the  VER  is  modulated  by  (or  at  least  correlated 
with)  certain  electroencephalogram  (EEG)  sig¬ 
nals.  For  example,  a  significant  relation  between 
VER  amplitude  and  alpha  rhythm  (8  to  13  Hz 
EEG  activity)  has  been  proposed  by  some20  and 
denied  by  others.22  Theoretical  predictions  in¬ 
dicate  a  negative  correlation  between  the  VER 
and  alpha  rhythm,  but  actual  measurements  in 
normal  subjects  often  yield  a  slight  positive  cor¬ 
relation  (References  21  and  24  and  R.  L.  Yolton, 
unpublished  observations). 

To  investigate  the  relation  between  VER  am¬ 
plitudes  and  other  EEG  frequencies,  a  Fourier 
transform  was  used  to  obtain  a  frequency  spec¬ 
trum  (1.0  Hz  resolution)  and  the  1.0  to  14.0  Hz 
EEG  activity  occurring  during  the  40  sec  period 
of  each  trial  for  which  VER  data  were  obtained. 
These  EEG  amplitudes  were  then  correlated 
with  the  corresponding  VER  amplitudes  across 
the  10  trials  for  each  subject.  None  of  the  r 
values  thus  produced  reached  significance  at  the 
0.01  level.  This  lack  of  significant  correlation 
values  suggests  that,  at  least  in  a  normal  popu¬ 
lation,  VER  amplitudes  cannot  be  shown  to  be 
modulated  by,  or  otherwise  directly  associated 
with,  EEG  frequencies  up  to  14.0  Hz. 

As  a  second  test  for  amplitude  modulation, 
data  from  four  separate  16.0  sec  epochs  for  two 
subjects  were  analyzed  using  an  FFT  which  pro¬ 
duced  0.0625  Hz  resolution.  If  sinusoidal  ampli¬ 
tude  modulation  of  the  15.0  Hz  VER  was  occur¬ 
ring,  the  FFT  power  spectrum  would  show  a  pair 
of  frequency  peaks  displaced  equal  distances 
above  and  below  the  15.0  Hz  VER  peak.  Fig.  3 
reveals  no  such  peaks  in  the  data  from  subjects 
E.  L.  and  D.  U.  There  is  no  consistent,  sustained 
amplitude  modulation  of  the  VER  detectable  in 
the  data  from  these  two  subjects. 

In  a  third  test  for  amplitude  modulation,  a 
sample  of  data  from  subject  D.  U.  was  used.  The 
raw  VER  data  were  analog  filtered  (Rockland 
bandpass  filter,  14-16  Hz)  to  produce  a  cycle  by 
cycle  plot.  Gross  observation  (Fig.  4)  and  a  Four¬ 
ier  analysis  of  these  variations  revealed  no  evi- 


Table  2.  Ratings  vs.  VER  Z-scores. 


VER  vs. 

»  * - 

Correlation 

Coafftctortf 

SignMca 

Attention 

0.0017 

NS 

Fixation 

0.001 

NS 

Accommodation 

0.01 

NS 

Uniformity 

0.0007 

NS 
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FREQUENCY  (CYCLES/SECOND) 

Fkj.  3.  Power  spectre  from  subjects  E.  L  (upper)  and  D.  U.  (tower).  Each  trace  represents  16  sec  ot  data 

analyzed  using  0.0625  Hz  «ns.  E.  C.  rtwwe  atoha  «c(Mty  at  about  9.0  Hr  and  both  show  VER  s  at  15.0  Hr. 

so  i  •  dance  of  amplitude  modulation.  Thus,  while  am¬ 

plitude  modulation  of  the  VER  might  exist  in 
ao-  .  •  short  bursts  (considerably  less  then  9.0  sec), 

(,t»i  .  .  •  •«  such  modulation  is  not  constant  enough  to  be 

'  «  '  **.•*"  ***  *  detected  using  a  Fourier  analysis, 

ao-  •**.•*•  „•  *  ’  it  is  also  clear  that  the  cycle  by  cycle  varia- 

w  *  tions  of  the  VER  are  poorly  related  to  the  sub- 

o  0  ■  1  .  ■  ^  ject’s  perception  as  she  strongly  disclaimed  any 

t  1  fluctuations  in  the  appearance  of  the  stimulus 

£  801  ...  *  •  ”  which  might  be  related  to  the  600%  changes  in 

J  e0.  m  *  amplitude  that  occurred  during  the  9.0  sec  view- 

ui  .*../****  •  ing  period.  If  cycle  by  cycle  amplitude  changes 

o  so-  /  .  •  •  •* ...  are  related  to  perception,  other  mechanisms  in 

5  .♦*  *  ...  the  visual  system  must  be  designed  to  remove 

>  a0‘  •• ..  their  effects. 


4<H.  . 


The  ensemble  averaging  process  is  designed 
to  finimias  the  effects  of  no  asynchronised 
noise  which  is  recorded  along  with  the  VER  and, 
neglecting  leakage,  the  FFT  eliminates  noise 
with  frequencies  outside  the  Fourier  bin  con- 
taining  the  VER  These  two  techniques  do  not, 
however,  ehmiaate  all  noise  contamination.  The 
amplitude  values  provided  by  the  FFT  may  be 
considered  to  be  the  sum  of  the  actual  VER  plus 
the  noise,  with  each  having  a  certain  mean  am¬ 
plitude  and  variability. 


Fie.  4. 
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Although  it  is  not  possible  to  directly  ascer¬ 
tain  the  fraction  of  the  measured  VER  which  is 
caused  by  noise,  a  determination  of  the  noise 
amplitude  and  variability  was  made  on  each  trial 
during  the  period  just  before  the  subject  viewed 
the  reversing  checkerboard  (Pig.  1).  An  exten¬ 
sive  discussion  of  the  effects  of  this  noise  on 
VER  variability  will  be  presented  in  the  section 
below  on  modeling. 

Other  Factors 

Because  the  VER  amplitudes  and  the  Vi’s  for 
the  nine  subjects  were  individually  quite  differ¬ 
ent,  intersubject  differences  were  correlated 
with  body  physiology  and  age.  To  make  these 
determinations,  correlations  relating  Vi’s,  S/N 
ratios,  and  mean  40  sec  VER  amplitudes  to  the 
subjects’  ages  and  their  height  to  weight  ratios 
were  determined  as  shown  in  Table  3.  The  sig¬ 
nificant  negative  correlation  between  VER  am¬ 
plitude  and  age  is  somewhat  surprising  because 
of  the  limited  age  range  represented  by  the  sub¬ 
jects  (20  to  39  years),  and  is  not  easy  to  explain. 
Decreases  in  skin  conductance  with  increasing 
age  cannot  be  the  cause  of  the  relationship  as 
all  subjects  had  approximately  equal  electrode 
resistances,  nor  can  relative  body  build  as  the 
height/weight  ratio  was  not  correlated  with  am¬ 
plitude. 

There  are  many  other  potential  sources  of 
VER  variability,  but  few  data  exist  to  substan¬ 
tiate  or  refute  their  relation  to  the  VER.  These 
factors  include  respiration  and  heart  rates,  blood 
flow  to  the  cortex,  time  since  the  last  meal, 
psychological  state,1®  drugs  the  subjects  may 
have  taken,"-31  etc.  One  study®  has  even  shown 
that  by  having  the  subject  imagine  or  hallucinate 
objects  which  come  between  her  and  the  display 
screen,  the  VUK  could  be  diminished  or  extin¬ 
guished. 

In  the  present  study  with  normal  subjects,  the 
variations  in  psychological  state,  blood  sugar, 
and  cortical  physiology  that  might  have  occurred 
during  a  single  recording  session  would  seem  to 


Table  3.  Age.  S/N,  and  height/weight  vs.  VI 
correlations. 


Comparison 

rvalue 

SlgnMoro* 

Age  vs.  VI 

0.32 

NS 

Age  vs.  amp«- 
tuOe 

-0.68 

p  <  0.06,  <1F  «•  7 

Age  vs  S/N 

-0.84 

NS 

1  InliAl  ft  I  lat^iS 

nmQrn/wmfpt 
vs.  VI 

0.23 

NS 

myn/wpgra 
vs  smpetuds 

-0.23 

NS 

llslf^llill  .liAi 

HPyn/fWIjnt 

vs.  S/N 

-0.49 

NS 

be  too  small  to  have  affected  the  VER’s  in  any 
significant  way,  but  further  data  are  needed  to 
allow  definitive  statements  to  be  made  about  the 
effects  of  such  subtle  factors. 

MOOEUNG 

Because  it  was  difficult  to  experimentally  sep¬ 
arate  the  effects  of  the  many  factors  which  con¬ 
tributed  to  VER  variability,  a  simulation  ap¬ 
proach  was  used  in  which  two  additive  sine 
waves  were  used  to  model  the  recorded  VER." 
In  the  model,  it  was  assumed  that  the  steady- 
state  VER  (VERr),  as  was  recorded  from  the 
subjects  described  above,  was  the  sum  of  two 
components:  a  “true”  VER  sinusoid  (VERr)  rep¬ 
resenting  the  activity  of  the  visual  system,  and 
a  noise  sinusoid  (N)  representing  the  residual 
noise  which  remained  after  ensemble  averaging 
and  Fourier  transformation.  The  frequencies  of 
VERr  and  N  were  assumed  to  be  equal,  and,  to 
simulate  the  “constant”  perceptual  appearance 
of  the  checkerboard  stimulus  over  relatively 
short  viewing  periods,  the  amplitude  of  VERr 
was  kept  constant.  The  amplitude  of  the  N  sine 
wave  was  varied,  however,  because  data  recorded 
from  the  nine  subjects  showed  that  the  actual 
amplitude  of  the  noise  (recorded  during  the  pe¬ 
riod  just  before  checkerboard  viewing)  varied 
from  trial  to  trial;  thus,  this  noise  variability 
was  incorporated  into  the  model. 

In  the  modeling  process  itself,  a  Data  General 
computer  was  used  to  add  together  the  VERr 
and  N  sine  waves;  each  addition  of  VERr  and 
N  produced  a  VERr  simulation.  These  VERr 
simulations  were  produced  in  sets  of  10  each  to 
simulate  the  10  trials  during  which  the  subjects’ 
VER  data  were  recorded.  Obviously,  the  ampli¬ 
tudes  of  the  10  VERr  waves  were  dependent  on 
the  phase  relation  between  the  VERr  and  N 
waves  at  the  time  of  addition  and,  as  there  was 
no  reason  to  assume  a  fixed  phase  relation,  the 
relation  was  varied  randomly  before  each  addi¬ 
tion.  Varying  this  relation  produced  a  consider¬ 
able  degree  of  variability  in  the  VERr  ampli¬ 
tudes. 

Additional  variability  was  produced  by  chang¬ 
ing  the  amplitude  of  N  before  each  addition. 
Ten  different  N  amplitudes  were  used  to  provide 
an  N  variability  index  of  62.5%  (which  was  equal 
to  the  mean  noise  VI  for  the  nine  subjects). 

The  computer  was  programmed  to  produce 
100  sets  of  10  VERr  simulations  and  then  to 
calculate  the  Vi’s  for  the  100  sets.  It  made  these 
calculations  for  different  mean  N  values  so  as 
to  produce  mean  S/N  ratios  ranging  from  2.5  to 
57,  as  shown  in  the  upper  portion  of  Fig.  5.  Also 
shown  is  a  zone  enclosing  plus  and  minus  2  SD’s 
from  the  mean  VI  values. 

The  lower  portion  of  Fig.  5  shows  the  Vi’s  for 
the  nine  subjects.  The  computer  modeling  pro- 
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Fto.  5.  Results  of  modeling.  In  the  upper  portion,  large  fled  circles  repreaent  VI  values  obtained  with  phase 
and  noise  amplitude  variaMty  (noise  VI  62.5%).  Sma»  IRad  circles  Meats  plus  and  minus  2  SD's  from  these 
means.  Each  S/N  ratio  is  determined  by  calculating  the  meat  of  the  MMdual  S/N  ratios  for  1000  VER« 
slmulatlone.  m  the  lower  portion  of  the  figure,  the  fled  drimonds  show  data  for  MMdual  subjects.  The  filed 
circles  show  the  plus  and  irtnus  2  SO  ranges  of  the  computer  predetions  for  each  subject's  data.  Predfctions  are 
based  on  subject's  MMdual  S/N  and  noise  VI  data. 


gram  was  used  to  predict  the  expected  mean  VI 
value  (and  plus  and  minus  2  SD  zone)  separately 
for  each  subject’s  individual  S/N  ratio  and  noiae 
VI.  Vi’s  for  three  of  the  subjects  are  in  the 
predicted  zones;  however,  six  are  considerably 
above  their  zones.  Thus,  if  the  modeling  ap¬ 
proach  is  valid,  either  the  variability  of  N  in¬ 
creased  during  the  time  these  six  subjects  were 
actually  viewing  the  checkerboard  (as  compand 
to  the  time  just  before  the  checkerboard  became 
visible),  or  them  was  variability  in  VERr  itself 
for  them,  or  them  was  a  third,  and  as  yet  un¬ 
known,  component  which  must  be  added  to 
VERr  *nd  N  to  yield  VER*.  Although  the  mod¬ 
eling  approach  does  not  allow  separation  of 
these  three  possibilities,  it  is  important  as  it 
does  show  that  reliable  VER’s  cannot  be  ex¬ 
pected  when  data  have  low  S/N  ratios. 

Thera  am  a  number  of  ways  to  deemaaa  the 
variability  of  VER  data  but  the  most  commonly 
used  method  is  simply  to  ensemble  average  mom 
epochs  until  the  derind  level  of  reliability  is 


achieved.  For  a  given  subject,  a  theoretical  ap¬ 
proximation  of  how  many  epochs  would  be 
needed  to  reach  a  desired  level  can  be  made  if 
the  S/N  ratio  for  a  sample  of  M  epochs  of  data 
is  known.  Equation  2  indicates  how  the  S/N 
ratio  changes  as  a  function  of  the  number  of 
epochs  ensemble  averaged''  and  the  S/N  ratio 
for  the  subject’s  M  epochs  of  data. 

S/N(o«»  apock)  x  VMnfc,  of  ipack,  nwnmft  ® 


Using  this  equation,  the  S/N  ratio  for  one  epoch 
can  be  calculated.  Next,  the  desired  VI  is  speci¬ 
fied,  and  the  8/N  ratio  required  for  this  VI  is 
determined.  Finally,  with  the  8/N  ratio  for  one 
epoch  and  the  required  8/N  ratio  determined, 
equation  2  can  be  eolved  for  M  which  givee  the 
total  number  of  epochs  which  must  be  eneembie 
averaged  to  produce  the  desired  reliability. 

These  calculations  assume  perfect  subjects 
and  do  not  consider  artifacts  which  may  make 
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Table  4.  Actual  and  predicted  data. 


Subject 

Actual  Data 

Predicted  Data 

Mean  S/N 
ratio  for 

40  epochs 

S/N  ratio 
for  1  epoch 

S/N  ratio 
required  for 

VI  of  5% 

Epochs  required 
to  reach 

VI  of  5% 

Total  time 
(in  min)  to 
reach  VI 
of  5%  assuming 

1.0  sec  epochs 

DU 

52.9 

8.4 

21.5 

18.3 

0.3 

GO 

19.3 

3.1 

33.4 

50.0 

0.8 

HO 

29.0 

4.6 

22.4 

46.9 

0.8 

BU 

13.4 

2.1 

40.0 

98.1 

1.6 

EL 

20.4 

3.2 

29.4 

58.5 

1.0 

HU 

14.1 

2.2 

24.0 

117.0 

2.0 

KL 

5.6 

0.9 

21.0 

630.6 

10.5 

DE 

13.2 

2.1 

35.9 

198.4 

3.3 

WO 

8.9 

1.4 

24.6 

763.1 

12.7 

data  more  variable  than  predicted  theoretically. 
The  calculations  also  do  not  take  into  account 
the  fact  that  very  long  observation  periods  could 
produce  habituation  or  fatigue  resulting  in  de¬ 
creases  in  VER  amplitudes  and  S/N  ratios.' 

To  show  how  these  calculations  apply  to  real 
subjects,  data  from  the  nine  subjects  described 
above  can  be  considered.  For  each  subject,  the 
S/N  ratio  for  one  epoch  is  determined  by  using 
equation  2  and  this  is  used  to  approximate  the 
number  of  epochs  necessary  to  achieve  a  VER 
amplitude  VI  of  5%.  (Note  that  the  S/N  ratio 
required  to  reach  the  5%  level  is  different  for 
each  subject  because  their  individual  noise  Vi’s 
were  used  in  calculating  the  ratios.)  Table  4 
shows  that  for  several  of  the  subjects,  an  exces¬ 
sively  large  number  of  1.0  sec  epochs  would  need 
to  be  averaged  to  produce  data  with  this  degree 
of  reliability. 

Thus,  use  of  two  relatively  simple  relations 
(VI  vs.  S/N  ratio,  and  S/N  ratio  change  vs. 
number  of  epochs  averaged)  allows  predictions 
to  be  made  with  respect  to  the  total  averaging 
time  necessary  to  produce  VER's  with  predeter¬ 
mined  degrees  of  variability.  These  relations 
should  be  used  with  caution,  however,  because 
of  the  factors  described  above  including  artifacts 
and  habituation. 

DISCUSSION 

In  1979,  Van  Brocklin  et  al."  quantified  what 
most  VER  researchers  already  knew— the  am¬ 
plitude  of  the  VER  is  variable.  The  subjects  in 
the  present  study  were  found  to  be  even  more 
variable  than  Van  Brocklin’s  and  this  degree  of 
variability  is  sufficient  to  render  questionable 
the  use  of  steady-state  VER  amplitudes  for  the 
reliable  assessment  of  vision.  Certainly,  the  am¬ 
plitude  changes  associated  with  eyes-open  vs. 
eyes-closed  conditions  can  be  discriminated  in 


most  subjects,  but  the  rating  scale  data  show  no 
correlations  between  VER  amplitude  fluctua¬ 
tions  and  fairly  large  changes  in  attention,  ocu¬ 
lar  status,  and  stimulus  perceptions.  The  lack  of 
correlations  suggests  that  the  amplitude  of  the 
VER  may  be  significantly  affected  by  nonvisual 
factors. 

Earlier  in  this  paper,  four  major  factors  were 
identified  which  might  contribute  to  VER  vari¬ 
ability:  analysis  procedures,  ocular  status,  cen¬ 
tral  processing,  and  noise.  Based  on  quality  as¬ 
surance  testing,  it  was  shown  that  artifacts  as¬ 
sociated  with  recording  devices  and  computer 
programming  did  not  contribute  significantly  to 
the  variability;  neither  did  VER  frequency  drifts 
nor  FFT  artifacts  such  as  aliasing.  The  signals 
that  were  processed  and  the  resulting  data  were 
valid  representations  of  events  occurring  in  the 
proximity  of  the  recording  electrodes. 

Although  processing  equipment  cannot  ac¬ 
count  for  a  significant  proportion  of  the  VER 
variability,  the  noise  which  was  recorded  and 
analyzed  along  with  the  VER  can.  In  the  mod¬ 
eling  experiment,  it  was  shown  that  essentially 
all  the  variability  in  the  data  from  three  of  the 
subjects  could  be  accounted  for  by  assuming  only 
a  random  phase  relation  between  variable  am¬ 
plitude  noise  and  constant  amplitude  true  VER 
components.  For  these  three  subjects,  the  only 
way  to  significantly  increase  the  reliability  of 
their  data  would  have  been  to  increase  their  S/ 
N  ratios.  As  noted,  this  could  be  done  by  using 
longer  ensemble  averaging  periods.  However, 
long  periods  would  make  it  difficult  to  follow 
rapidly  changing  visual  phenomena.  Also,  with 
very  long  averaging  periods,  subjects  tend  to 
habituate  or  become  restless  am)  may  produce 
artifacts  associated  with  gross  body  movements. 
These  large  amplitude  artifacts  might  be  re¬ 
moved  by  the  use  of  an  active  rejection  system, 
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but  the  effects  of  such  artifact  rejection  cannot 
be  estimated. 

Data  from  sis  subjects  showed  more  variabil¬ 
ity  than  could  be  accounted  for  by  the  model. 
For  these  subjects,  ocular,  eye  position,  or  cen¬ 
tral  nervous  system  changes  may  have  added 
variability.  Undoubtedly,  each  of  the  subjects 
experienced  changes  in  her/his  ocular  status 
during  the  stimulus  viewing  period,  and  fixation 
drifts,  changes  in  pupil  size,  blinking,  and  simi¬ 
lar  factors  clearly  have  the  potential  for  affect¬ 
ing  the  amplitude  of  the  VER.  However,  findings 
such  as  the  subjects'  low  blink  rates  and  the  lack 
of  correlation  between  the  ocular  status  rating 
scales  and  the  VER  amplitudes  make  it  difficult 
to  conclude  that  a  significant  proportion  of  VER 
variability  was  caused  by  changes  in  these  func¬ 
tions.  Further  work  in  this  area  will  be  needed 
to  demonstrate  whether  the  modeling  assump¬ 
tion  of  no  variability  in  VERr  is  valid  or  if  it 
must  be  modified. 

It  was  also  not  possible  to  demonstrate  a 
consistent  relation  between  the  subjects’  central 
nervous  system  processing  of  the  VER  check¬ 
erboard  image  and  amplitude  variability.  No 
EEC  rhythms,  including  alpha,  were  consis¬ 
tently  correlated  with  VER  amplitudes  and 
there  was  no  correlation  with  the  subjects’  at¬ 
tention  ratings.  Major  changes  in  attention, 
such  as  might  be  produced  by  a  threat  of  electric 
shock,  could  change  VER  amplitudes,40  but  the 
smaller  attentional  fluctuations  reported  by  the 
subjects  did  not  seem  to  have  this  effect. 

The  lack  of  correlation  between  VER  ampli¬ 
tudes  and  perceptual  reports,  and  the  inability 
to  find  any  EEG  signals  which  covaried  with  the 
VER,  raise  doubts  about  major  contributions  of 
changes  in  cortical  processing  to  VER  variabil¬ 
ity.  Although  negative  evidence  does  not  prove 
the  lack  of  a  relation,  the  effects  of  changes  in 
cortical  processing,  in  a  controlled  situation,  do 
not  seem  large. 

CONCLUMOItt 

We  conclude  that  a  major  proportion  of  the 
variability  shown  by  the  subjects  used  in  this 
study  is  caused  by  noise  analyzed  along  with  the 
VER.  For  three  subjects,  no  other  factor  need 
be  considered  to  explain  all  their  variability.  For 
the  others,  noise  plus  some  combination  of  ar¬ 
tifacts  may  be  used  to  explain  the  variability. 
Additional  work  will  be  needed  to  separate  the 
relative  contributions  of  these  artifacts. 
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